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We describe a practical experimental protocol for robustly characterizing the error rates of non- 
Clifford gates associated with dihedral groups, including gates in SU(2) associated with arbitrarily 
small angle rotations. Our dihedral benchmarking protocol is a generalization of randomized bench¬ 
marking that relaxes the usual unitary 2-design condition. Combining this protocol with existing 
randomized benchmarking schemes enables an efficient means of characterizing universal gate sets 
for quantum information processing in a way that is independent of state-preparation and mea¬ 
surement errors, fn particular, our protocol enables direct benchmarking of the T gate (sometime 
called 7r/8-gate) even for the gate-dependent error model that is expected in leading approaches to 
fault-tolerant quantum computation. 


A universal quantum computer is a device allowing 
for the implementation of arbitrary unitary transforma¬ 
tions. As with any scenario involving control, a practical 
quantum computation will inevitably have errors. While 
the complexity of quantum dynamics is what enables the 
unique capabilities of quantum computation, including 
important applications such as quantum simulation and 
Shor’s factoring algorithm, that same complexity poses a 
unique challenge to efficiently characterizing the errors. 
One approach is quantum process tomography mm, 
which yields an informationally-complete characteriza¬ 
tion of the errors on arbitrary quantum gates, but re¬ 
quires resources that scale exponentially in the number 
of qubits. Moreover, quantum process tomography can 
not distinguish errors associated with the quantum gates 
from those associated with state-preparation and mea¬ 
surement (SPAM) [3]. 

Randomized benchmarking mm using a unitary 2- 
design 015], such as the Clifford group, overcomes both 
of these limitations by providing an estimate of the error 
rate per gate averaged over the 2-design. More specifi¬ 
cally, it is a method for efficiently estimating the average 
fidelity 

■■= j d'lf{lp\£{tp)\lp) ( 1 ) 

of a noise map £ associated with any group of quan¬ 
tum operations forming a unitary 2-design in a way that 
is independent of SPAM errors. This partial informa¬ 
tion is useful in practice as it provides an efficient means 
of tuning-up experimental performance, and, moreover, 
provides a bound on the threshold error rate required 
for fault tolerant quantum computing cni, a bound that 
becomes tight when the noise is stochastic [Bin]. 

An important limitation of existing randomized bench¬ 
marking methods is that they are only efficient in the 
number of qubits 000 for non-universal sets of gates 
such as the Clifford group. While Clifford gates play 
an important role in leading approaches to fault-tolerant 
quantum computation based on stabilizer codes uni , one 


still needs a means of benchmarking the remaining non- 
Cifford gates required for universality; this is particu¬ 
larly important because the non-Clifford gates will be 
implemented via magic state distillation and gate injec¬ 
tion [HIS], which is a complex procedure that will be 
subject to dramatically different error rates than those 
of the (physical or logical) Clifford gates. 

In the present paper, we describe a protocol for bench¬ 
marking the average fidelity of a group of operations cor¬ 
responding to the dihedral group which does not sat¬ 
isfy the usual 2-design constraint for randomized bench¬ 
marking. However, we show that the dihedral bench¬ 
marking protocol still allows the average hdelity to be 
estimated while retaining the benefits of standard ran¬ 
domized benchmarking. Furthermore, by combining our 
dihedral benchmarking protocol with both standard 0 
and interleaved randomized benchmarking m, we give 
an explicit method for characterizing the average fidelity 
of the T gate directly. This is of particular interest be¬ 
cause the T gate combined with the generators of the 
Clifford group (e.g., the CNOT, the Hadamard and the 
Pauli gates) provides a standard gate set for generating 
universal quantum computation. Moreover our protocol 
enables characterization of non-Clifford gates associated 
with arbitrarily small angle rotations, which are of inter¬ 
est to achieve more efficient fault-tolerant circuits [THl - 
HTj. Remarkably, our protocol overcomes the key as¬ 
sumption of ‘weak gate-dependence’ of the noise that 
limits previous benchmarking protocols. Specifically, the 
protocol is robust in the important setting when the error 
on the non-Clifford gate, such as the T gate, is substan¬ 
tially different from the error on the Clifford operations. 
As noted above, this is the expected scenario in leading 
approaches to fault-tolerant quantum computation. 

Characterizing single-qubit unitary groups .—We now 
outline a protocol that yields the average gate hdelity of 
the experimental implementation of a single-qubit uni¬ 
tary group of the form 

V, = {R,{1),X), (2) 
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FIG. 1. The orbit, under the action of the dihedral group 'Dg, 
of an input state located at a 45° degree latitude on the Bloch 
sphere. Rs{z) are the rotations of the octagon, while is a 
reflection (or a rotation in 3 dimensions, with the rotation axis 
parallel to the octagon’s surface). The T gate corresponds to 
the smallest rotation iZ8(l). 


where j is a positive integer and 

Rj{z) := = cos(27r2;/j)I + ism{2Trz/j)Z. (3) 

Up to an overall sign, Vj is a representation of the di¬ 
hedral group of order 2j, with XRj{z) — Rj{z + j)X, 
which is not a unitary 2 -design and includes gates pro¬ 
ducing arbitrarily small rotations as j increases. Note 
that the choice of rotation axis is arbitrary, and that 
any single-qubit gate can be written as i?j(l) relative 
to some axis. Consequently, our protocol will allow any 
single-qubit gate to be benchmarked. The Bloch sphere 
representation of Rg acting on a qubit state is illustrated 
in fig. B This group contains the so-called T gate, which 
corresponds to the i? 8 (l) rotation. 

The dihedral benchmarking protocol is as follows. 

1. Choose two binary strings of length m, z = 

{zi,...,Zm) G and x = G in¬ 

dependently and uniformly at random. 

2. Prepare a system in an arbitrary initial state pQ 

3. At each time step t = 1,... ,m, apply Rj{zt)X^*. 

4. Apply the inversion gate, defined as 

Ginv. :=x^-z»^ 

where , 62 G Z 2 are fixed by considerations below. 


^ The constants A and B appearing in eqns. and depend on 
state preparation, as shown in eqns. [T5})17| These constants may 
be maximized by choosing an appropriate state preparation (and 
the corresponding measurement). In particular, optimal states 
for eqn. [^and eqn.j^are |0)(0| and |+)(+| respectively. 


5. Perform a POVM {E,I - E} ^ {+1,-1} 

for some i? « p, to estimate the probability 
q{+l\m, X, z, 61 , 62 ) of outome -1-1. 

6 . Repeat steps 1-5 k times, where k is fixed by the 
requirement to estimate the survival probability 

Pr(m, 61 , 62 ) := J2x,z 9(+l|"i, ^ 1 , ^ 2 ) 

to a desired precision (see [ziiiHiiin] for details on 
the required sampling complexity). 

For 61 = 62 = 0, the average survival probability is 

Pr(TO, 0, 0) = Ap™ + Rp™ + G , (4) 

where A, B and G are constants absorbing SPAM factors. 
Because a sum of two exponentials leads to a non-linear 
fitting problem, it should generally be advantageous to 
fit instead to 

Pr(TO, 0,0) -I- Pr(TO, 0,1) 

—Pr(TO, 1,0) — Pr(m, 1,1) = 4Ap™ (5) 

and 

Pr(m,0,0)-Pr(m,0,l) = 2Rp5". ( 6 ) 

As we will show below, the average gate fidelity is related 
to the fit parameters po and pi by 

•Favg.('£’) = 2 + 2pi). (7) 

Analysis .—We now derive the formula for the decay 
curves expressed in eqns.|4[J^ together with the average 
fidelity eqn. We assume that the experimental noise is 
completely positive and trace-preserving and is also gate 
and time-independent (though perturbative approaches 
to relax these assumptions can be considered nms]) , so 
that we can represent the experimental implementation 
of TZj (z) o as £ o TZj (z) o X^. We use calligraphic font 
to denote abstract channels (where, for a unitary U, the 
abstract channel U corresponds to conjugation by U) and 
o to denote channel composition (i.e., Bo A means apply 
A then B). We refer to 

£^ = {\g\)-^'^U-^o£oU ( 8 ) 

ueg 

as the twirl of £ over a group Q. Averaged over all se¬ 
quences X and z of length m, our protocol yields the 
following effective channel 

C = £oX^^Z^^o{£'^^Y'^ . ( 9 ) 

The Pauli-Liouville representation (see, e.g.. Ref. m 
for details) of an abstract channel £ consists in a matrix 
of inner products between Pauli matrices Pj and their 
images £{Pk) 


£,k = Tr(U,£-(Pfe)) . 


( 10 ) 
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We denote this representation with the bold font S. The 
Pauli-Liouville representation of 'Dj is a direct sum of 
three inequivalent irreducible representations (irreps) of 
the dihedral group: 

1 . Rj{z)X^ —)■ 1 (trivial representation) 


cos( 27 rz/j) 
sin( 27 r 2 ;/j) 
(faithful representation) 


2 . Rj{z)X^ 


(_l)a:+l sin( 27 rz/j) \ 
(-l)^cos( 27 r 2 :/j) ) 


3. Rj{z)X^ —>■ (—1)"^ (parity representation). 

This is easily seen by looking at the action of Vj on 
the Bloch sphere (see fig. [^. The trivial representation 
emerges from the unitality and trace-preserving proper¬ 
ties of unitary operations, which map any Bloch shell 
of constant radius to itself, including the center point. 
The parity representation encodes the fact that the ±Z 
poles of the Bloch sphere are invariant under conjuga¬ 
tion by Rj{z) and swapped under conjugation by X. 
The two-dimensional representation encodes the action 
of Rj{z)X^ on the XT-plane of the Bloch sphere. 

As a consequence of Schur’s lemmas (see the supple¬ 
mentary information of Ref. | 20 j'). the twirled noise chan¬ 
nel is a direct sum of three identity matrices: 


/ 1 0 0 0 \ 

0 Pi 0 0 I 

0 0 Pi 0 ’ 

Vo 0 0 po/ 


( 11 ) 


where po := Sa and pi := With these defini¬ 

tions, the average fidelity is mnn] 


•^avg.(f) 


Z + ^(^22 + ^33 + ^ 44 ) 
2 o 

2 + ^(Po + 2 pi) 


( 12 ) 


as in eqn. Using eqn. El the effective channel C from 
eqn. can readily be expressed as 


/ 1 0 0 \ 

0 (-l)^=pr 0 0 

0 0 (-l)^i+^ 2 pj" 0 

V 0 0 0 (- 1 )'’^^™ / 

(13) 

Therefore the survival probability is 


Eqns. [djl^then follow from appropriate choices of bi,b 2 
and simple algebra. 

Characterizing the T gate .—The T gate, or the i? 8 (l) 
operation (see eqn. [^, is important in many implemen¬ 
tations since it is used to supplement the Clifford gates 
to achieve universal quantum computation. In leading 
approaches to fault-tolerant error-correction, the T gate 
is physically realized via magic-state injection m , in 
which magic states are acted upon by Clifford transfor¬ 
mation and post-selected stabilizer measurements. Be¬ 
cause the physical (logical) Clifford gates are applied di¬ 
rectly (transversally) whereas the T gate is implemented 
through the above method, the error on the T gate may 
be substantially different and requires separate charac¬ 
terization. While the quality of the injected gate can be 
assessed by measuring the quality of the input and out¬ 
put magic states as well as benchmarking the required 
stabilizer operations, here we provide a direct method to 
estimate the average gate fidelity of the T gate. 

The T gate is contained in Vg, (see eqn. [^. Vg can be 
divided in two cosets: I ?4 and T ■ V^. 1 ) 4 , a subgroup of 
Vg, is generated by X and the phase gate S, which are 
both Clifford operations. If the average fidelity over Vg 
and I ?4 are similar, this is an indication that the T gate 
has similar average fidelity as the Clifford group. How¬ 
ever, typically this will not hold for the reasons stated 
above, in which case we suggest the following protocol. 
First benchmark I ?4 as per the above protocol. Then 
adapt interleaved randomized benchmarking [ 20 ] to the 
above protocol by replacing steps 3 and 4 (with j = 4) 
with the two following steps: 

3'. At each time step t = 1,..., m, apply 
Rg{l) o R 4 {zt)X-K 

4'. Apply the inversion gate, defined as 

Ginv. := X^^Z^- l\T=i[R8a)R4izt)X-^V. 

We require the sequence length to be even, so that the 
inversion gate is in 'D 4 . Fitting the two decay curves 
obtained from eqns. and allows the average fidelity 
■Xavg.i^T ° £) of the composite noise map to be esti¬ 
mated via eqn. The average fidelity of the T gate, 
•^avg. (^r), is then estimated from the approximation 
Xoo°^ = XooXoo which is valid to within the implicit 
bound derived in [ 22 ] : 


Pr(TO, 61 , 62 ) = Tr {E C{p)) 

= (-l)^Mp™ + ((-1)^1+^= Hi + (-I)'’^R2) pT + C , 

(14) 

where 

A :=2-^ ■Tr(E-£(Z))-Tr(pZ) , (15) 

Bi := 2-1 • Tr (A • £(¥)) ■ Tr (pV) , (16) 

B 2 := 2-1 • Tr (A • £(X)) ■ Tr (pX) , (17) 

= 2-1-Tr (A-£■(!)) . (18) 


IXoo ^ XooXoo I — 2 \/(l Xoo)Xoo(l Xoo )Xoo 

+ (l-Xoo)(l-Xoo) > ( 19 ) 

where in the qubit case 

X^0 = ^-^avg.(O-^ . (20) 

This bound is loose in general but tight when the Clif¬ 
ford gates in £>4 have much higher fidelity than the T 
gate (which is the regime of interest when optimizing the 
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Sequence length, in 


FIG. 2. (Color online) Decay curves corresponding to eqns.[^ 
and for a standard randomized benchmarking simnlation 
with A = ^ and B = | respectively. The shallow (blue) 
and steep (orange) lines correspond to eqn. and eqn. re¬ 
spectively. Each data point is obtained after averaging 500 
sequences of fixed length. The noise model used to obtained 
this hgure is described in the Numerical simulation section. 
Fits to the data give an estimated value for average fidelity 
over ©8 of 0.99257(9), which compares well with the true value 
of 0.9925. 


overhead and fidelity of the distillation and injection rou¬ 
tines) [23]. 

Numerical simulation. —Although the previous analy¬ 
sis is derived for gate- and time-independent noise, the 
randomized benchmarking protocol is both theoretically 
and practically robust to some level of gate-dependent 
noise iziiin]. We now illustrate through numerical simu¬ 
lations that this robustness holds for the dihedral bench¬ 
marking protocol, particularly in the regime where the 
noise is strongly gate-dependent (as expected when the 
gates are implemented using different methods, namely, 
direct unitaries and magic state injection). 

For our simulations, each operation within the dihedral 
group I?8 is generated by composing two gates; the first 
gate is in the subgroup generated by X and the phase 
gate S = i?8(2), while the second gate is either identity 
or the T = i?8(l) gate. The error associated with the 
first gate is a simple depolarizing channel with an average 
fidelity of 0.9975. For the second gate, the error arises 
only after the T gate, and corresponds to an over-rotation 
with an average fidelity of 0.99. The total average fidelity 
over I?8 is 0.9925. Fig. shows the two decay curves 
described by eqns. and [^ Appropriate fits lead to a 
precise estimate of 0.99257(9) for the average fidelity. 

We also simulate the interleaved randomized bench¬ 
marking protocol in two different regimes (see fig.[^. The 
first regime (fig. corresponds to over-rotation errors 
that are small for the Clifford operations, with average 
fidelity 1 — 10“®, but large for the T gate, with average 
fidelity 1 — 10“^. The estimate of the fidelity of the T 
gate via our protocol is extremely precise in this regime: 
0.9902(3). The second regime (fig. Ep) corresponds to a 
similar over-rotation with average fidelity 0.99 both for 
the Clifford group and the T gate. In this case the esti¬ 
mated value of is 0.966 and the implicit bound 

from eqn. [l^only guarantees Xa.v^X^T) to lie the interval 




FIG. 3. Decay curves corresponding to eqns. and for an 
interleaved randomized benchmarking simulation with with 
A = \ and B = | respectively. The shallow (blue) and steep 
(orange) lines correspond to eqn. [^ and eqn. [^ respectively. 
Each data point is obtained after averaging 500 sequences of 
fixed length. The noise model used to obtained this figure 
is described in the Numerical simulation section. The top 
figure corresponds to high fidelity Glifford operations and a 
relatively noisy T gate. The bottom figure corresponds to 
errors of the same magnitude on the Glifford operations and 
the T gate. See text for details. 


[0.928, 0.995]. The rather loose bound in this regime is an 
open problem for interleaved randomized benchmarking 
and is not specific to the current protocol. 

Conclusions. —We have provided a protocol that ex¬ 
tracts the average fidelity of the error arising over a group 
of single-qubit operations corresponding to the dihedral 
group. Of particular importance are I?8 and I? 4 , which 
enable efficient and precise benchmarking of the T gate 
that plays a unique and important role in leading pro¬ 
posals for fault-tolerant quantum computation. 

While we have explicitly assumed that the rotation axis 
is the z axis, this is an arbitrary choice. Since any single¬ 
qubit unitary can be written as a rotation about some 
axis on the Bloch sphere, our protocol can be used to 
characterize any single-qubit gate. 

The essence of this paper is to realize that the 2-design 
restriction originally imposed in randomized benchmark¬ 
ing is too strict. Indeed, randomized benchmarking can 
be applied to any group whose Liouville representation 
contains few inequivalent irreps. Unraveling the class of 
all such algebraic structures is an open problem, though 
interesting groups such as {CZ,X,Rj{l)) abound, which 
would allow gates such as the T gate to be characterized 
‘in vivo’ within an n-qubit circuit |24j . 
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